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DETAILED ACTION 

1. This action is responsive to communications: Original Application filed 4/6/2001 
and IDS filed 11/8/2002. 

2. Claims 1-44 are pending. Claims 1 and 24 are independent claims. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-18, 20-41 and 43-44 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Eintracht et al. (herein after Eintracht) U.S. Patent No. 6,687,878 
Bl filed 3/15/1999 in view of Schelling et al. (herein after Schelling) U.S. 5,706,097 
filed 1/6/1998 provided by the applicant. 

In regard to independent claim 1, Eintracht discloses displaying the image and 
a plurality of icons, each icon being associated with metadata; selecting at least one of 
said icons depending on at least one... of the image (Eintracht Col 15 Lines 10-23 and 
Figs IB and 1C i.e. Note Icons that are selected, which contain information about an 
image)(Eintracht Col 14 Lines 14-22 i.e. selecting an annotation); and storing the 
metadata associated with said selected icon as an annotation of the subject of the image. 
(Eintracht Col 19 Lines 42-67 i.e. storing notes associated with a document or image). 

Eintracht does not specifically mention where there is a subject of the annotation 
is displayed with the icon is placed on the images. However, Schelling mentions a subject 
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matter descriptor which indicates the type of subject matter in the data file (Schelling Col 
2 Lines 4-15). It would have been obvious to one of ordinary skill in the art to apply 
Schelling to Eintracht, providing Eintracht the benefit of detecting the subject of an 
image without having to individually go into each image to find out the subject, which 
would save time for the user. 

In regard to dependent claim 2, Eintracht discloses selecting at least one of said 
icons depending on said at least one subject of the image; dragging the selected icon to 
the image; dropping the dragged icon on the ... the image (Eintracht Col 15 Lines 24-27 
i.e. grabbing a note icon and dragging it to a new location on the image); and detecting 
the ... the position at which the icon is dropped, wherein said storing step stores the 
metadata associated with the dropped icon as an annotation ...of the image. (Eintracht 
Col 15 Lines 10-23 and Figs IB and 1C i.e. Note Icons that are selected, which contain 
information about an image which can be places on the image when the icon is dropped) 

Eintracht does not specifically mention where there is a subject of the annotation 
is displayed with the icon is placed on the images. However, Schelling mentions a subject 
matter descriptor which indicates the type of subject matter in the data file (Schelling Col 
2 Lines 1-15). It would have been obvious to one of ordinary skill in the art to apply 
Schelling to Eintracht, providing Eintracht the benefit of detecting the subject of an 
image without having to individually go into each image to find out the subject, which 
would save time for the user. 

In regard to dependent claim 3, Eintracht does not specifically disclose wherein 
said detecting step extracts the subject from the image based on the dropped position 
when the dragged icdn is dropped on the image. However, Schelling mentions a subject 
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matter descriptor which indicates the type of subject matter in the data file (Schelling Col 
2 Lines 1-15). It would have been obvious to one of ordinary skill in the art to apply 
Schelling to Eintracht, providing Eintracht the benefit of detecting the subject of an 
image without having to individually go into each image to find out the subject, which 
would save time for the user. 

In regard to dependent claim 4, Eintracht discloses wherein said subject is 
extracted based on the color information of the dropped position (Eintracht Col 7 Line 
10-15 i.e. based on note color label). 

In regard to dependent claim 5, Eintracht discloses wherein said detecting step , 
extracts a predetermined sized region of ... dropped position and said storing step stores 
the metadata associated with the dropped icon as an annotation .... (Eintracht Col 10 
Line 64-67 and Col 11 Lines 1-6 i.e. creating limits on the size) (Eintracht Col 15 Lines 
10-23 and Figs IB and 1C i.e. Note Icons that are selected, which contain information 
about an image)(Eintracht Col 14 Lines 14-22 i.e. selecting an annotation) (Eintracht Col 
19 Lines 42-67 i.e. storing notes associated with a document or image). 

Eintracht does not specifically mention where there is a subject of the annotation 
is displayed with the icon is placed on the images. However, Schelling mentions a subject 
matter descriptor which indicates the type of subject matter in the data file (Schelling Col 
2 Lines 1-15). It would have been obvious to one of ordinary skill in the art to apply 
Schelling to Eintracht, providing Eintracht the benefit of detecting the subject of an 
image without having to individually go into each image to find out the subject, which 
would save time for the user. 
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In regard to dependent claim 6, Eintracht discloses constructing regions about 
locations at which said subject is rendered in said image. (Eintracht Col 15 Lines 10-14 
i.e. region box is created where the cursor is placed to write an annotation). 

In regard to dependent claim 7, Eintracht discloses wherein said detecting step 
detects one of the regions of the subject based on the position at which the icon is 
dropped, and said storing step stores the metadata associated with the dropped icon as 
an annotation of the detected region of ... the image. (Eintracht Col 15 Lines 10-14 i.e. 
region box is created where the cursor is placed to write an annotation). (Eintracht Col 15 
Lines 24-27 i.e. grabbing a note icon and dragging it to a new location on the image) 
(Eintracht Col 15 Lines 10-23 and Figs IB and 1C i.e. Note Icons that are selected, which 
contain information about an image) 

Eintracht does not specifically mention where there is a subject of the annotation 
is displayed with the icon is placed on the images. However, Schelling mentions a subject 
matter descriptor which indicates the type of subject matter in the data file (Schelling Col 
2 Lines 1-15). It would have been obvious to one of ordinary skill in the art to apply 
Schelling to Eintracht, providing Eintracht the benefit of detecting the subject of an 
image without having to individually go into each image to find out the subject, which 
would save time for the user. 

In regard to dependent claim 8, Eintracht discloses dragging the selected icon 
to the image; and emphasizing the region under the dragged icon. (Eintracht Col 15 
Lines 24-35 i.e. Notes can be created by selecting an annotation tool on the screen and 
placing the cursor in the area of the image where it is desired to place a note. A box is 
created and the user can enter text. Once entered, the text appears in the form of a 
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"stick' note that appears on top of the image. The Note Anchor is created at the location 
the user placed the note. Notes can be viewed by double clicking, for example, on a 
note icon. Note icons are displayed on the screen when the viewing option is set to 
display both notes and the image. A note can be closed after viewing by clicking on the 
box in the upper left-hand corner of the title bar 32 (FIG. 2). Note that alternatively, 
graphics can be entered into a note rather than test. In this case, a graphics tool or 
marker is used to place graphics in the note) 

In regard to dependent claim 9, Eintracht discloses further comprising the step 
of constructing a bounding box about locations at which said subject is rendered in said 
image. (Eintracht Col 15 Lines 10-14 i.e. region box is created where the cursor is placed 
to write an annotation and subject). 

In regard to dependent claim 10, Eintracht discloses further comprising the step 
of storing the location of said bounding box. (Eintracht Col 15 Lines 10-17 i.e. region 
box is created where the cursor is placed to write an annotation and subject at a certain 
location). 

In regard to dependent claim 11, Eintracht discloses further comprising the step 
of extracting a part of said image based on the bounding box. (Eintracht Col 6 Lines 65- 
67 and Col 7 Lines 1-17) 

In regard to dependent claim 12, Eintracht discloses further comprising the step 
of displaying the extracted part of said image. (Eintracht Col 6 Lines 65-67 and Col 7 
Lines 1-17) 

In regard to dependent claim 13, Eintracht discloses wherein a size of said 
bounding box is determined automatically. (Eintracht Col 15 Lines 10-17 i.e. region box 
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is created where the cursor is placed to write an annotation and subject at a certain 

location and Col 10 Lines 64-67 and Col 1 1 Lines 1-5). 

In regard to dependent claim 14, Eintracht discloses wherein a size of said 

bounding box is changeable by a user. (Eintracht Col 15 Lines 10-17 i.e. region box is 

created where the cursor is placed to write an annotation and subject at a certain location 

and Col 10 Lines 64-67 and Col 1 1 Lines 1-5). 

In regard to dependent claim 15, Eintracht discloses wherein said metadata as 
the annotation of the subject is displayed upon selecting said subject in the image. 
(Eintracht Col 7 Lines 13-17 i.e. the display may include Note Event description, Note 
Owner ID, user name, path, originator IP address, time and Note Contents. When a note 
is selected on the Note List, its counterpart icon in the document window frame is 
highlighted) 

In regard to dependent claim 16, Eintracht discloses providing a list of 
metadata; and associating the list of metadata and the plurality of icons. (Eintracht Col 
7 Lines 4-17 i.e. the image window 18 displays the image with the plurality of 
annotations on top of the image. The Note List window displays a list of all the 
annotations associated with the image shown in window. The user can optionally sort 
the Note List by Note Owner ID, Note Time Stamp, Note color label and Note Contents. 
The display may include Note Event description, Note Owner ID, user name, path, 
originator IP address, time and Note Contents. When a note is selected on the Note List, 
its counterpart icon in the document window frame is highlighted) 
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In regard to dependent claim 17, Eintracht discloses wherein said list of 
metadata is provided from a database. (Eintracht Col 7 Lines 44-46 i.e. coupled to a 
notes database). 

In regard to dependent claim 18, Eintracht discloses wherein said storing step 
stores the metadata as the annotation of the subject of the image by using a tag 
indicating an association with said image. (Eintracht Col 3 Lines 13-36 i.e. the 
document file for storing one or more documents, a notes database located on the server, 
the notes database for storing one or more notes, each note or tag associated with a 
particular document or subject, one or more notes clients coupled to a network, each 
notes client operative to locally display a representation of a document remotely stored 
on the server in the document file, the notes client adapted to permit a user to annotate 
the document with one or more notes, the notes client operative to simultaneously 
display the one or more notes associated with the document over the displayed 
document such that the document is viewable along with the one or more notes) 

In regard to dependent claim 20, Eintracht discloses further comprising the step 
of e-mailing at least the image to at least one e-mail address based on the metadata 
associated with the image. (Eintracht Col 22 Lines 33-37 i.e. emails to client or user) 

In regard to dependent claim 21, Eintracht discloses further comprising the step 
of replacing the default icon by the icon generated based on the subject of the image. 
(Eintracht Col 3 Lines 33-37 i.e. updating the notes server with any notes events 
processed by the notes clients and for updating the notes client with the results of 
synchronization updates previously performed by other notes clients since the last 
synchronization event and Col 15 Lines 15-17 i.e. icons) 
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In regard to dependent claim 22, Eintracht discloses a computer program for a 
computer, comprising software code portions for performing the steps (Eintracht Col 28 
Lines 1-27) 

In regard to dependent claim 23, Eintracht discloses a computer readable 
medium storing a computer program, wherein said computer program comprises 
software code portions for performing the steps (Eintracht Col 28 Lines 1-27) 

In regard to independent claim 24, claim 24 in addition to the following reflects 
similar subject matter claimed in claim 1 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 25, claim 25 in addition to the following reflects 
similar subject matter claimed in claim 2 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 26, claim 26 in addition to the following reflects 
similar subject matter claimed in claim 3 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 27, claim 27 in addition to the following reflects 
similar subject matter claimed in claim 4 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 28, claim 28 in addition to the following reflects 
similar subject matter claimed in claim 5 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 
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In regard to dependent claim 29, claim 29 in addition to the following reflects 
similar subject matter claimed in claim 6 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 30, claim 30 in addition to the following reflects 
similar subject matter claimed in claim 7 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 31, claim 31 in addition to the following reflects 
similar subject matter claimed in claim 8 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 32, claim 32 in addition to the following reflects 
similar subject matter claimed in claim 9 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 33, claim 33 in addition to the following reflects 
similar subject matter claimed in claim 10 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 34, claim 34 in addition to the following reflects 
similar subject matter claimed in claim 11 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 35, claim 35 in addition to the following reflects 
similar subject matter claimed in claim 12 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 
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In regard to dependent claim 36, claim 36 in addition to the following reflects 
similar subject matter claimed in claim 13 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 37, claim 37 in addition to the following reflects 
similar subject matter claimed in claim 14 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 38, claim 38 in addition to the following reflects 
similar subject matter claimed in claim 15 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 39, claim 39 in addition to the following reflects 
similar subject matter claimed in claim 16 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 40, claim 40 in addition to the following reflects 
similar subject matter claimed in claim 17 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 41, claim 41 in addition to the following reflects 
similar subject matter claimed in claim 18 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

In regard to dependent claim 43, claim 43 in addition to the following reflects 
similar subject matter claimed in claim 20 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 
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In regard to dependent claim 44, claim 44 in addition to the following reflects 
similar subject matter claimed in claim 21 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 

5. Claims 19 and 42 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Eintracht et al. (herein after Eintracht) in view of Schelling et al. (herein after 
Schelling) as applied to claims 1 and 24 and in further view of Martin et al. (herein 
after Martin) U.S. Patent No. 6,272,484 Bl filed 5/27/1998. 

In regard to dependent claim 19, Eintracht does not disclose wherein the 
metadata associated with the subject of the image is stored in an XML file. However, 
Martin mentions a format for storing documents being XML (Martin Col 6 Lines 30-33). 
It would have been obvious to one of ordinary skill in the art to apply Martin to Eintracht, 
providing Eintracht the benefit of storing the data in an XML format which would be 
option format when the user accesses a document over the internet of which there are 
many formats for different web pages as taught by Martin Col 6 Lines 29-37) 

In regard to dependent claim 42, claim 42 in addition to the following reflects 
similar subject matter claimed in claim 19 and is rejected along the same rationale. A 
Display, selection and storage means (Eintracht Col 20 Line 16-22). 
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Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Levin et al. U.S. Patent No. 5,231,578 issued 7/27/1993 

Levineetal. U.S. Patent No. 5,680,636 issued 10/21/1997 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Londra C Burge whose telephone number is 703-305- 
8784. The examiner can normally be reached on 8:30am to 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon can be reached on 703-308-5186. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 

(STEI 

Londra Burge 
7/21/04 
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